Display device, image processing apparatus, display method and non-transitory computer readable medium storing program

ABSTRACT

A display device includes: a display unit that displays a screen including a displayed item; and a display controller that, in moving the displayed item toward a designated position on the screen, when designation of the moving is terminated in a state where the displayed item and the designated position are separated by a distance longer than a predetermined distance, performs control to continuously display the screen until the displayed item and the designated position at a time of terminating the designation come within the predetermined distance, or a setting screen about setting based on an operation by an operator is displayed.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC §119 fromJapanese Patent Application No. 2016-248953 filed Dec. 22, 2016.

BACKGROUND Technical Field

The present invention relates to a display device, an image processingapparatus, a display method and a non-transitory computer readablemedium storing a program.

Related Art

In recent years, many display devices or other devices have touch panelsto accept touch operations by operators.

SUMMARY

According to an aspect of the present invention, there is provided adisplay device including: a display unit that displays a screenincluding a displayed item; and a display controller that, in moving thedisplayed item toward a designated position on the screen, whendesignation of the moving is terminated in a state where the displayeditem and the designated position are separated by a distance longer thana predetermined distance, performs control to continuously display thescreen until the displayed item and the designated position at a time ofterminating the designation come within the predetermined distance, or asetting screen about setting based on an operation by an operator isdisplayed.

BRIEF DESCRIPTION OF THE DRAWINGS

An exemplary embodiment of the present invention will be described indetail based on the following figures, wherein:

FIG. 1 is a diagram showing a hardware configuration example of an imageprocessing apparatus according to the exemplary embodiment;

FIG. 2 is a block diagram showing a functional configuration example ofa controller included in the image processing apparatus according to theexemplary embodiment;

FIGS. 3A to 3D are diagrams for illustrating a specific example ofprocessing for displaying a setting screen in a first form or a settingscreen in a second form;

FIG. 4 is a flowchart showing a specific example of procedures inprocessing for displaying the setting screen in the first form or thesetting screen in the second form;

FIGS. 5A to 5D are diagrams for illustrating a specific example ofprocessing in the setting screen in the first form;

FIG. 6 is a flowchart showing a specific example of procedures inprocessing in the setting screen in the first form;

FIGS. 7A and 7B are diagrams for illustrating a specific example ofprocessing in the setting screen in the second form;

FIG. 8 is a flowchart showing a specific example of procedures inprocessing in the setting screen in the second form;

FIGS. 9A and 9B are diagrams showing another specific example of thesetting screen in the first form;

FIGS. 9C and 9D are diagrams showing another specific example of thesetting screen in the second form; and

FIG. 10 is a diagram showing a hardware configuration example of acomputer to which the exemplary embodiment can be applied.

DETAILED DESCRIPTION

Hereinafter, an exemplary embodiment according to the present inventionwill be described in detail with reference to attached drawings.

<Hardware Configuration of Image Processing Apparatus>

First, a hardware configuration of an image processing apparatus 100 towhich the exemplary embodiment according to the present invention isapplied will be described. FIG. 1 is a diagram showing the hardwareconfiguration example of the image processing apparatus 100 according tothe exemplary embodiment. The image processing apparatus 100, as anexample of a display device, is a so-called multifunction machineincluding an image processing function, such as, for example, a scanningfunction, a printing function, a copying function and a facsimilefunction. As shown in FIG. 1, the image processing apparatus 100includes: a controller 10; a display section 104; an image readingsection 105; an image forming section 106; a communication section 107;and a memory 108. Note that the respective functional sections areconnected to a bus 109, and performs data transmission and reception viathe bus 109.

The controller 10 controls each section of the image processingapparatus 100. The controller 10 is configured with a CPU (CentralProcessing Unit) 101, a ROM (Read Only Memory) 102 and a RAM (RandomAccess Memory) 103.

Here, the CPU 101 executes various kinds of programs, such as an OS(Operating System) or applications. Moreover, the ROM 102 is a memorythat stores a control program executed by the CPU 101. The RAM 103 is amemory used as a working memory or the like for the CPU 101. Then, theCPU 101 reads the control program stored in the ROM 102 and executes thecontrol program using the RAM 103 as a work area. When the controlprogram is executed by the CPU 101, each function in the imageprocessing apparatus 100 is implemented.

The display section 104, as an example of a display unit, is configuredwith, for example, a liquid crystal touch panel display, and displaysdata related to, for example, the image processing apparatus 100 underthe control of the controller 10. Moreover, the display section 104displays a screen for receiving operation from an operator, and receivesthe operation from the operator through the screen. As a measure fordetecting the contact, anything, such as a measure for detecting basedon a pressure caused by the contact, or a measure for detecting based onstatic electricity of a contact item, may be used.

Note that, in the following description, an operation performed bycontact of an operator's finger with the screen will be described as acontact operation; however, a contact operation by an operator is notlimited to an operation by a finger, and the operation may be performedby, for example, a touch pen or others held by the operator.

The image reading section 105, as an example of an image processor,reads an image formed on a document, and creates image data indicatingthe read image. Here, the image reading section 105 is, for example, ascanner, in which a CCD system that reduces reflected light of lightemitted to a document from a light source by a lens and receives thereduced reflected light by a CCD (Charge Coupled Devices), a CIS systemthat receives reflected light of light sequentially emitted to adocument from an LED light source by a CIS (Contact Image Sensor), orthe like may be employed.

The image forming section 106, as an example of an image processor,includes a print mechanism that forms an image on a recording medium,such as a sheet. Here, the image forming section 106 is, for example, aprinter, and a printer of an electrophotographic system that forms animage by transferring toner attached to a photoreceptor onto a recordingmedium or a printer of an ink jet system that forms an image by ejectingink onto a sheet may be used.

The communication section 107 is connected to a not-shown communicationline and functions as a communication interface that performstransmission and reception of various kinds of data with other devicesconnected to the communication line. For example, via the communicationsection 107, transmission and reception of image data with other devicesare performed.

The memory 108 includes a storage region, such as a hard disk device,and stores, for example, data received by the communication section 107or data created by the image processing apparatus 100.

<Functional Configuration of Controller>

Next, a functional configuration of the controller 10 included in theimage processing apparatus 100 according to the exemplary embodimentwill be described. FIG. 2 is a block diagram showing a functionalconfiguration example of the controller 10 included in the imageprocessing apparatus 100 according to the exemplary embodiment. Thecontroller 10 includes: an operation detection section 111; a CPU loaddetermination section 112; a display screen creation section 113; adistance determination section 114; and a display controller 115.

The operation detection section 111 detects contact operation by anoperator on a screen of the display section 104 and accepts operationinput from the operator. Here, for example, the operation detectionsection 111 assumes that an orthogonal coordinate system exists on thedisplay section 104, and when an operator's finger contacts the displaysection 104, the operation detection section 111 detects the coordinatesof the contact point. Then, based on the detected coordinates, theoperation detection section 111 determines the type of the contactoperation by the operator, and accepts operation input from theoperator. As the contact operation to be determined, for example, “tap”,“drag” or others are shown. “Tap” is an operation in which an operator'sfinger touches a screen as if the finger lightly strikes the screen.“Drag” is an operation in which an operator moves his/her finger whilethe operator's finger is in touch with the screen.

The CPU load determination section 112 determines whether or not theload of the CPU 101 (how much load is applied to the CPU 101) satisfiesa predetermined condition. To put it another way, the CPU loaddetermination section 112 determines whether or not the load of the CPU101 exceeds a predetermined threshold value. More specifically, the CPUload determination section 112 makes determination about the load of theCPU 101 when the operation detection section 111 detects a specificoperation by an operator. As the specific operation, for example, anoperation to select a specific image displayed on a screen (for example,an operation to “tap” a specific image) can be shown.

Moreover, as the load of the CPU 101, for example, CPU utilization (CPUloading factor), that is, a value indicating percentages of a programrunning in the image processing device 100 occupying the processing timeof the CPU 101, is used. As the predetermined threshold value, forexample, “80%” of the CPU utilization can be shown.

Moreover, as a case in which the load on the CPU 101 is large, to put itanother way, as a case in which the load on the CPU 101 is larger thanthe predetermined threshold value, for example, a case in whichprocessing for image data is performed in the image processing apparatus100 can be shown. As the case in which processing for image data isperformed, for example, a case in which reading processing (scanningprocessing) of a document is performed in the image reading section 105,a case in which print processing of a document is performed in the imageforming section 106, or others, can be provided.

The display screen creation section 113 creates a setting screen inresponse to the load of the CPU 101. More specifically, the displayscreen creation section 113 creates a setting screen in a first formwhen the CPU load determination section 112 has determined that the loadof the CPU 101 exceeds a predetermined threshold value. Moreover, thedisplay screen creation section 113 creates a setting screen in a secondform when the CPU load determination section 112 has determined that theload of the CPU 101 is not more than a predetermined threshold value.

Here, the setting screen in the first form refers to, in moving adisplayed item toward a position on a screen designated by an operator,a screen that accepts input of setting and is switched (cleared) when adesignating operation by the operator is terminated, in other words,when the operator removes his/her finger from the screen. On the otherhand, the setting screen in the second form refers to, in moving adisplayed item toward a position on a screen designated by an operator,a screen that accepts input of setting and is switched (cleared) uponfurther accepting an operation to confirm setting contents from theoperator after a designating operation by the operator is terminated.

To additionally describe, in the setting screen in the first form, inputof setting is accepted by designation on the screen and removal of afinger by an operator; however, in the setting screen in the secondform, input of setting is accepted by a further operation on the screenafter designation on the screen by an operator and removal of his/herfinger. In this way, in the setting screen in the second form, anoperator is required more operation procedures than in the settingscreen in the first form.

On the other hand, the setting screen in the first form is displayed,for example, to overlap an existing screen that has already beendisplayed in conjunction with the existing screen; however, the settingscreen in the second form is newly displayed, for example, as a screendifferent from an existing screen without considering positionalrelationship with the existing screen. Therefore, in the setting screenin the second form, the load on the CPU 101 related to the display issmaller than in the setting screen in the first form.

When an operator starts a designating operation on the setting screen inthe first form, the distance determination section 114 observes adistance between the position designated by the operator and thedisplayed item. Then, when designation of moving for the displayed itemis terminated, in other words, when the operator's finger is removedfrom the screen, the distance determination section 114 determineswhether or not a designated position when the designation by theoperator is terminated (hereinafter, referred to as a designatedposition upon termination) and the displayed item are in a state ofbeing separated by a distance longer than a predetermined distance. Thedetermination result will be used, to be described later, in displaycontrol of the display controller 115.

Moreover, when the operator starts designating operation on the settingscreen in the second form, the distance determination section 114 alsoobserves a distance between a position designated by the operator and adisplayed item in a similar manner. Then, when an operation to confirmsetting contents (a setting operation) is performed on the settingscreen in the second form after the designation of moving for thedisplayed item is terminated, the distance determination section 114determines whether or not the displayed item and the designated positionupon termination are in a state of being separated by a distance longerthan a predetermined distance. The determination result will be used, tobe described later, in display control of the display controller 115.

The display controller 115, as an example of a display controller,outputs data for causing a touch panel display of the display section104 to display an image, to thereby control the display on the displaysection 104. For example, when the operation to “drag” is performed, thedisplay controller 115 controls the display on the display section 104to move a displayed item toward a designated position designated by anoperator (to follow a designated position). Moreover, for example, whenthe setting screen in the first form or the setting screen in the secondform is created by the display screen creation section 113, the displaycontroller 115 displays the created setting screen in the first form orsetting screen in the second form on the display section 104.

Further, after displaying the setting screen in the first form or thesetting screen in the second form, the display controller 115 controlsthe display on the display section 104 in response to the determinationresult of the distance determination section 114.

First, processing in the setting screen in the first form will bedescribed. When it is determined by the distance determination section114 that the displayed item and the designated position upon terminationare in the state of being separated by a distance longer than thepredetermined distance in the setting screen in the first form, thedisplay controller 115 continues displaying of the setting screen in thefirst form until the displayed item and the designated position upontermination come within the predetermined distance. Then, when thedisplayed item and the designated position upon termination come withinthe predetermined distance, the display controller 115 switches (clears)the setting screen in the first form.

Here, it may be possible that, when it is determined that the displayeditem and the designated position upon termination are in a state ofbeing separated by a distance longer than the predetermined distance,the display controller 115 is configured to continue to display thesetting screen in the first form until a screen showing setting contentsset by designation from an operator or a screen for accepting input ofsetting by an operator is displayed.

Note that the screen showing setting contents set by designation fromthe operator or the screen for accepting input of setting by theoperator is used as an example of a setting screen about setting basedon an operation by an operator.

Next, processing in the setting screen in the second form will bedescribed. In the setting screen in the second form, the displaycontroller 115 subsequently moves the displayed item toward thedesignated position upon termination even after designation by theoperator is terminated. Then, when an operation to confirm the settingcontents is performed and it is determined by the distance determinationsection 114 that the displayed item and the designated position upontermination are in the state of being separated by a distance longerthan the predetermined distance in the setting screen in the secondform, the display controller 115 continues display of the setting screenin the second form until the displayed item and the designated positionupon termination come within the predetermined distance. Then, when thedisplayed item and the designated position upon termination come withinthe predetermined distance, the display controller 115 switches (clears)the setting screen in the second form.

Here, it may be possible that, when it is determined that the displayeditem and the designated position upon termination are in a state ofbeing separated by a distance longer than the predetermined distance,similar to the case in which the setting screen in the first form isdisplayed, the display controller 115 is configured to continue todisplay the setting screen in the second form until a screen showingsetting contents set by designation from the an operator or a screen foraccepting input of setting by an operator is displayed.

Note that each functional section constituting the controller 10 of theimage processing apparatus 100 shown in FIG. 2 is implemented bycooperation of software and hardware resources. Specifically, the CPU101 reads the programs for implementing the operation detection section111, the CPU load determination section 112, the display screen creationsection 113, the distance determination section 114, the displaycontroller 115 and the like, for example, from the ROM 102 into the RAM103 and executes thereof, and accordingly, these functional sections areimplemented.

<Description of Processing for Displaying Setting Screen in First Formor Setting Screen in Second Form>

Next, processing for displaying the setting screen in the first form orthe setting screen in the second form will be described while taking aspecific example. FIGS. 3A to 3D are diagrams for illustrating thespecific example of processing for displaying the setting screen in thefirst form or the setting screen in the second form.

First, it is assumed that a screen 21 shown in FIG. 3A is displayed onthe display section 104. The screen 21 is a screen for performingsetting about image processing. On the screen 21, images 21 a to 21 eare provided as images corresponding to five setting items, “Setting A”,“Setting B”, “Setting C”, “Lighten/Darken” and “Setting D”,respectively.

Here, as shown in FIG. 3B, it is assumed that the image 21 d of“Lighten/Darken” is selected by an operator from among the five settingitems. Specifically, when the operator's finger touches the image 21 dof “Lighten/Darken” as if to lightly strike thereof, the operationdetection section 111 detects the operation of “tap” on the image 21 dof “Lighten/Darken” and accepts selection of the image 21 d.

When the operation detection section 111 accepts selection of the image21 d, the CPU load determination section 112 obtains informationindicating the load of the CPU 101 (CPU utilization). Then, the CPU loaddetermination section 112 determines whether or not the load of the CPU101 exceeds a predetermined threshold value. When the load of the CPU101 exceeds the predetermined threshold value, the display screencreation section 113 creates the setting screen in the first form. Then,the display controller 115 displays the created setting screen in thefirst form. On the other hand, when the load of the CPU 101 is not morethan the predetermined threshold value, the display screen creationsection 113 creates the setting screen in the second form. Then, thedisplay controller 115 displays the created setting screen in the secondform.

FIG. 3C is a diagram showing another specific example of the settingscreen in the first form. In the specific example shown in the figure, ascreen 22 is the setting screen in the first form. The screen 22performs setting about “Lighten/Darken”, and is displayed to overlap thescreen 21 that has already been displayed. More specifically, the screen22 includes a slider 22 a and a knob 22 b. In the slider 22 a, as asetting value (setting item) of “Lighten/ Darken”, scale marks “+3”,“+2”, “+1”, “0”, “−1”, “−2” and “−3” are provided. Moreover, at the timeof displaying the screen 22, the knob 22 b exists at a position of thescale mark “0”.

For example, when an operator points the knob 22 b positioned at thescale mark “0” and moves his/her finger while pointing the knob 22 b,the knob 22 b also moves toward the designated position. For example,assuming that an operator removes his/her finger from the screen in astate in which the operator moves his/her finger to the position of “+3”and the knob 22 b also moves to the position of “+3” to follow thefinger. In this case, an input for setting “+3” for “Lighten/Darken” isperformed, the screen 22 is cleared and the screen 21 is displayed to bevisually recognized.

FIG. 3D is a diagram showing another specific example of the settingscreen in the second form. In the specific example shown in the figure,a screen 23 is the setting screen in the second form. Similar to thescreen 22, the screen 23 also performs setting about “Lighten/Darken”.The screen 23 is displayed as a screen different from the screen 21 thathas already been displayed. Note that the screen 23 may be displayed tooverlap the screen 21 or not to overlap the screen 21. Morespecifically, the screen 23 includes a slider 23 a and a knob 23 b. Inthe slider 23 a, similar to the slider 22 a, as a setting value (settingitem) of “Lighten/Darken”, scale marks “+3”, “+2”, “+1”, “0”, “−1”, “−2”and “−3” are provided. Moreover, at the time of displaying the screen23, the knob 23 b exists at a position of the scale mark “0”.

For example, when an operator points the knob 23 b positioned at thescale mark “0” and moves his/her finger while pointing the knob 23 b,the knob 23 b also moves toward the designated position. For example,assuming that an operator removes his/her finger from the screen andselects (presses) a confirmation button 23 c after the operator moveshis/her finger to the position of “+3” and the knob 23 b also moves tothe position of “+3” to follow the finger. In this case, an input forsetting “+3” for “Lighten/Darken” is performed, the screen 23 is clearedand the screen 21 is displayed to be visually recognized.

Here, when an operation to cancel the setting made by a designatingoperation is not performed within a predetermined time after thedesignating operation is terminated on the setting screen in the secondform, it may be possible to perform processing on the assumption that anoperation to confirm the setting contents has been accepted. In thespecific example shown in FIG. 3D, when an operation to cancel thesetting of “+3” for “Lighten/Darken” is not performed within apredetermined time after terminating the designating operation,processing is performed on the assumption that the confirmation button23 c has been selected. In other words, the operation detection section111 accepts the setting input of “+3” and the display controller 115clears the screen 23. Note that, as the operation to cancel the settingmade by the designating operation, for example, an operation to select acancel button 23 d shown in FIG. 3D can be provided.

<Procedures in Processing for Displaying Setting Screen in First Form orSetting Screen in Second Form>

Next, procedures in processing for displaying the setting screen in thefirst form or the setting screen in the second form will be described.FIG. 4 is a flowchart showing a specific example of procedures inprocessing for displaying the setting screen in the first form or thesetting screen in the second form.

First, the operation detection section 111 determines whether or not aspecific operation by an operator is detected (step 101). Here, thespecific operation refers to an operation by which an operator selects aspecific setting item, such as, for example, the images 21 a to 21 eshown in FIG. 3A. When any specific operation is not detected (No instep 101), determination in step 101 is subsequently performed. On theother hand, when a specific operation is detected (Yes in step 101), theCPU load determination section 112 obtains information indicating theload of the CPU 101 (CPU utilization) (step 102). Next, the CPU loaddetermination section 112 determines whether or not the load of the CPU101 exceeds a predetermined threshold value (step 103).

When it is determined that the load of the CPU 101 is not more than thepredetermined threshold value (No in step 103), the display screencreation section 113 creates the setting screen in the first form (step104). On the other hand, when it is determined that the load of the CPU101 exceeds the predetermined threshold value (Yes in step 103), thedisplay screen creation section 113 creates the setting screen in thesecond form (step 105). Next, the display controller 115 performscontrol to display the created setting screen, that is, the settingscreen in the first form or the setting screen in the second form (step106). Then, the processing flow is ended.

For example, when the load of the CPU 101 of the image processingapparatus 100 is large, it takes time to reflect the designatingoperation of the operator on the screen in some cases. Therefore, forexample, moving of the displayed item, such as the knob 22 b or the knob23 b, cannot be on time and moving of the displayed item to the positiondesignated by an operator is delayed in some cases. For example, ifmoving of the displayed item is delayed and designation is terminated inthe state in which the displayed item has not moved to the positiondesignated by the operator and then the screen is switched, it can beconsidered that it is difficult for the operator to distinguish on whichposition the setting is performed, the position designated by theoperator, or the position of the displayed item. Here, for example, dueto the specification of the image processing apparatus 100, if theoperator recognizes that the setting is performed at the position of thedisplayed item despite that the setting is actually performed at theposition designated by the operator, the operator is led tomisrecognition about the setting. Moreover, for example, due to thespecification of the image processing apparatus 100, if the operatorrecognizes that the setting is performed at the position designated byhim/her despite that the setting is actually performed at the positionof the displayed item, the operator is also led to misrecognition aboutthe setting.

Therefore, the image processing apparatus 100 related to the exemplaryembodiment displays the setting screen in the second form when the loadof the CPU 101 is larger than the predetermined threshold value. In thesetting screen in the second form, there are more operation proceduresthan in the setting screen in the first form, but the load on the CPU101 is smaller. For example, an operator may perform an operation toconfirm the setting contents after confirming that the displayed itemhas moved to the designated position on the screen. On the other hand,the image processing apparatus 100 displays the setting screen in thefirst form when the load of the CPU 101 is not more than thepredetermined threshold value. In the setting screen in the first form,there are less operation procedures than in the setting screen in thesecond form, and thereby the operation procedures of the operator aresimplified.

However, even though the setting screen in the first form is displayedwhen the load of the CPU 101 is not more than the predeterminedthreshold value, for example, if the operator performs the designatingoperation fast, it can be considered that the moving of the displayeditem is delayed, and thereby the designation is terminated in the statewhere the displayed item has not moved to the position designated by theoperator. Moreover, even though the setting screen in the second form isdisplayed when the load of the CPU 101 is larger than the predeterminedthreshold value, for example, it can be considered that the operatorperforms the operation to confirm the setting contents in the statewhere the displayed item has not moved to the position designated by theoperator. In these cases, there is a possibility that it is difficultfor the operator to distinguish on which position the setting isperformed, the position designated by the operator, or the position ofthe displayed item; accordingly, the operator is led to misrecognitionabout the setting.

Therefore, the image processing apparatus 100 related to the exemplaryembodiment observes the distance between the position designated by theoperator and the displayed item. Then, when the designation of moving isterminated in a state where the designated position and the displayeditem are separated by a distance longer than the predetermined distance,the image processing apparatus 100 controls so that displaying of thesetting screen in the first form or the setting screen in the secondform is continued until the displayed item and the designated positionupon termination come within the predetermined distance. Alternatively,the image processing apparatus 100 performs control to continuedisplaying of the setting screen in the first form or the setting screenin the second form until a screen showing setting contents set bydesignation from an operator or a screen for accepting input of settingby an operator is displayed.

Note that, in the above-described example, the CPU load determinationsection 112 determines whether or not the load of the CPU 101 exceedsthe predetermined threshold value, and according to the determinationresult, the setting screen in the first form or the setting screen inthe second form is displayed; however, there is no limitation to such aconfiguration. The image processing apparatus 100 related to theexemplary embodiment may display the setting screen in the first form orthe setting screen in the second form regardless of the load of the CPU101, in other words, without measuring the load of the CPU 101 but inaccordance with predetermined rules about display of the screen. Then,even when the setting screen in the first form or the setting screen inthe second form is displayed without measuring the load of the CPU 101,it may be possible to observe the distance between the positiondesignated by the operator and the displayed item (to performdetermination processing by the distance determination section 114), tothereby control the display of the screen.

<Description of Processing in Setting Screen in First Form>

A description will be given of the processing in the setting screen inthe first form by taking a specific example. FIGS. 5A to 5D are diagramsfor illustrating a specific example of the processing in the settingscreen in the first form. Here, the description will be given on theassumption that the processing is performed on the screen 22 shown inFIG. 3C.

First, as shown in FIG. 5A, for example, when an operator moves his/herfinger in the direction of the arrow in the state where the operator'sfinger is in touch with the knob 22 b on the screen 22, the displaycontroller 115 performs control to move the knob 22 b toward thedesignated position of the finger. Next, when the operator terminatesthe designating operation (that is, when the operator removes his/herfinger from the screen 22), the distance determination section 114measures the distance between the designated position upon terminationand the knob 22 b. Then, the distance determination section 114determines whether or not the designated position upon termination andthe knob 22 b are in a state of being separated by a distance longerthan a predetermined distance.

Here, when the designated position upon termination and the knob 22 bare within the predetermined distance, as has been described in FIG. 3C,the operation detection section 111 accepts the input of settingcorresponding to the designated position upon termination (that is,setting corresponding to the position of the knob 22 b when thedesignation is terminated). Moreover, the display controller 115 clearsthe screen 22 and displays the screen 21 to be visually recognized. Notethat the state where the designated position and the displayed item arewithin the predetermined distance means, for example, a state where thedisplayed item has moved to the designated position.

On the other hand, in the specific example shown in FIG. 5B, adesignated position upon termination 22 c and the knob 22 b are in astate of being separated by a distance longer than a predetermineddistance. In such a case, the display controller 115 performs control tocontinue display of the screen 22 until the designated position upontermination 22 c and the knob 22 b are brought into the state within thepredetermined distance, that is, until the knob 22 b has moved to thedesignated position upon termination 22 c. Then, when the knob 22 bmoves toward the designated position upon termination 22 c by thecontrol of the display controller 115 and thereby the designatedposition upon termination 22 c and the knob 22 b come within thepredetermined distance, the operation detection section 111 accepts theinput of setting corresponding to the designated position upontermination 22 c (that is, setting corresponding to the position of theknob 22 b after moving). Moreover, the display controller 115 clears thescreen 22 and displays the screen 21 to be visually recognized.

Further, it may be possible that, when the designation of moving isterminated in a state where the designated position upon termination 22c and the knob 22 b are in a state of being separated by a distancelonger than the predetermined distance, the display controller 115 maynewly display a screen showing setting contents set by designation froman operator or a screen for accepting input of setting by an operator.

More specifically, when the designation of moving is terminated in astate where the designated position upon termination 22 c and the knob22 b are in a state of being separated by a distance longer than thepredetermined distance, the display controller 115 displays, as shown inFIG. 5C, a screen 24 showing setting contents corresponding to thedesignated position upon termination 22 c. The screen 24 shows that thesetting of “+3” that is a setting value corresponding to the designatedposition upon termination 22 c is performed with respect to“Lighten/Darken”. To additionally describe, the operation detectionsection 111 accepts input of the setting “+3” for “Lighten/Darken”.Moreover, the display controller 115 may clear the screen 22 at thetiming of displaying the screen 24, or display the screen 24 to overlapthe screen 22 and clear the screen 22 and the screen 24 after apredetermined time has passed.

Note that, in the specific example shown in FIG. 5C, the screen 24 thatshows the setting contents corresponding to the designated position upontermination 22 c is displayed; however, due to the specification of theimage processing apparatus 100, it can be considered that the settingcorresponding not to the designated position upon termination 22 c, butto the position of the displayed item, is performed. In such a case, onthe screen 24, the setting contents corresponding to the position of thedisplayed item at the time of displaying the screen 24 (in the specificexample shown in FIG. 5B, the position of “+2”) is shown.

Further, when the designation of moving is terminated in a state wherethe designated position upon termination 22 c and the knob 22 b are in astate of being separated by a distance longer than the predetermineddistance, the display controller 115 displays, for example, as shown inFIG. 5D, a screen 25 for accepting input of setting by the operator. Thescreen 25 accepts selection of any of setting values “−3” to “+3” for“Lighten/Darken”. The display controller 115, for example, may clear thescreen 22 at the timing of displaying the screen 25, display the screen25 to overlap the screen 22, or clear the screen 22 and the screen 25 atthe timing of accepting the input of the setting value on the screen 25.Note that the configuration is not limited to the one like the screen 25in which selection is made from among plural setting values; forexample, a screen to which a value that an operator wants to set isactually inputted may be displayed.

Note that, in the specific examples shown in FIGS. 5A to 5D, it isassumed that an operator points the knob 22 b positioned at the scalemark “0” and moves the knob 22 b to follow the moving of the designatedposition; however, the configuration is not limited thereto. Forexample, when an operator first points a position where the knob 22 bdoes not exist (for example, the position of “+2”), the knob 22 b isalso controlled to move toward the designated position. Then, based onthe determination result of the distance determination section 114,display control is performed.

<Procedures in Processing in Setting Screen in First Form>

Next, procedures in processing in the setting screen in the first formwill be described. FIG. 6 is a flowchart showing a specific example ofprocedures in processing in the setting screen in the first form.

First, the operation detection section 111 determines whether or nottermination of the designating operation to move the displayed item tothe designated position is detected in the setting screen in the firstform (step 201). When termination of the designating operation is notdetected (No in step 201), determination in step 201 is subsequentlyperformed. On the other hand, when termination of the designatingoperation is detected (Yes in step 201), the distance determinationsection 114 determines whether or not the designated position upontermination and the displayed item are in a state of being separated bya distance longer than a predetermined distance (step 202). When it isdetermined that the designated position upon termination and thedisplayed item are within the predetermined distance (No in step 202),the operation detection section 111 accepts input of the settingcorresponding to the designated position upon termination and thedisplay controller 115 clears the setting screen in the first form (step203). Then, the processing flow is ended.

On the other hand, when it is determined, in step 202, that thedesignated position upon termination and the displayed item are in astate of being separated by a distance longer than the predetermineddistance (Yes in step 202), the operation detection section 115 movesthe displayed item toward the designated position upon termination andcontinues displaying of the setting screen in the first form (step 204).Then, the process proceeds to step 202. In this manner, the displaycontroller 115 continues to display the setting screen in the first formuntil the designated position upon termination and the displayed itemcome within the predetermined distance. When the designated positionupon termination and the displayed item come within the predetermineddistance (that is, negative (No) determination is made in step 202), theprocess proceeds to step 203.

Moreover, in step 202, the display controller 115 may also display ascreen showing setting contents set by designation from an operator, asthe screen 24 shown in FIG. 5C, or a screen for accepting input ofsetting by an operator, as the screen 25 shown in FIG. 5D, instead ofwaiting for until the designated position upon termination and thedisplayed item come into a state within the predetermined distance.

Further, in step 202, when the designated position upon termination andthe displayed item do not come into a state within the predetermineddistance though a predetermined time has passed, the display controller115 may display the screen 24 or the screen 25.

<Description of Processing in Setting Screen in Second Form>

Next, a description will be given of the processing in the settingscreen in the second form by taking a specific example. FIGS. 7A and 7Bare diagrams for illustrating a specific example of processing in thesetting screen in the second form. Here, the description will be givenon the assumption that the processing is performed on the screen 23shown in FIG. 3D.

First, as shown in FIG. 7A, for example, when an operator moves his/herfinger in the direction of the arrow in the state where the operator'sfinger is in touch with the knob 23 b on the screen 23, the displaycontroller 115 performs control to move the knob 23 b toward thedesignated position of the finger. The display controller 115subsequently moves the displayed item toward the designated positionupon termination even after the operator terminates the designatingoperation.

Next, when the confirmation button 23 c is selected, the distancedetermination section 114 measures the distance between the designatedposition upon termination and the knob 23 b. Then, the distancedetermination section 114 determines whether or not the designatedposition upon termination and the knob 23 b are in a state of beingseparated by a distance longer than a predetermined distance. Here, whenthe designated position upon termination and the knob 23 b are withinthe predetermined distance, as has been described in FIG. 3D, theoperation detection section 111 accepts the input of settingcorresponding to the designated position upon termination (that is,setting corresponding to the position of the knob 23 b when theconfirmation button 23 c is selected). Moreover, the display controller115 clears the screen 23 and displays the screen 21 to be visuallyrecognized.

On the other hand, in the specific example shown in FIG. 7B, adesignated position upon termination 23 e and the knob 23 b are in astate of being separated by a distance longer than a predetermineddistance. In such a case, the display controller 115 performs control tocontinue display of the screen 23 until the designated position upontermination 23 e and the knob 23 b are brought into the state within thepredetermined distance. Then, when the knob 23 b moves toward thedesignated position upon termination 23 e by the control of the displaycontroller 115 and thereby the designated position upon termination 23 eand the knob 23 b come within the predetermined distance, the operationdetection section 111 accepts the input of setting corresponding to thedesignated position upon termination 23 e (that is, settingcorresponding to the position of the knob 23 b after moving). Moreover,the display controller 115 clears the screen 23 and displays the screen21 to be visually recognized.

Further, when the confirmation button 23 c is selected in a state wherethe designated position upon termination 23 e and the knob 23 b are in astate of being separated by a distance longer than the predetermineddistance, similar to the case in which the setting screen in the firstform is displayed, the display controller 115 may display a screenshowing setting contents set by designation from an operator, as thescreen 24 shown in FIG. 5C. In this case, the display controller 115 mayclear the screen 23 at the timing of displaying the screen 24, ordisplay the screen 24 to overlap the screen 23 and clear the screen 23and the screen 24 after a predetermined time has passed.

Moreover, the display controller 115 may display, not the screen 24, butthe screen for accepting input of setting by an operator, as the screen25 shown in FIG. 5D. In this case, the display controller 115, forexample, may clear the screen 23 at the timing of displaying the screen25, display the screen 25 to overlap the screen 23, or clear the screen23 and the screen 25 at the timing of accepting the input of the settingvalue on the screen 25.

Note that, in the specific examples shown in FIGS. 7A and 7B, it isassumed that an operator points the knob 23 b positioned at the scalemark “0” and moves the knob 23 b to follow the moving of the designatedposition; however, the configuration is not limited thereto. Forexample, when an operator first points a position where the knob 23 bdoes not exist (for example, the position of “+2”), the knob 23 b isalso controlled to move toward the designated position. Then, based onthe determination result of the distance determination section 114,display control is performed.

Moreover, when an operation to cancel the setting made by a designatingoperation is not performed within a predetermined time after thedesignating operation is terminated on the setting screen in the secondform, the distance determination section 114 may determine the distancebetween the designated position upon termination and the displayed itemon the assumption that an operation to confirm the setting contents hasbeen accepted.

<Procedures in Processing in Setting Screen in Second Form>

Next, procedures in processing in the setting screen in the second formwill be described. FIG. 8 is a flowchart showing a specific example ofprocedures in processing in the setting screen in the second form.

First, the display controller 115, in the setting screen in the secondform, subsequently moves the displayed item toward the designatedposition upon termination even after the designating operation to movethe displayed item to the designated position is terminated. Then, theoperation detection section 111 determines whether or not an operationto confirm the setting contents is detected (step 301). When anyoperation to confirm the setting contents is not detected (No in step301), determination in step 301 is subsequently performed. On the otherhand, when the operation to confirm the setting contents is detected(Yes in step 301), the distance determination section 114 determineswhether or not the designated position upon termination and thedisplayed item are in a state of being separated by a distance longerthan a predetermined distance (step 302). When it is determined that thedesignated position upon termination and the displayed item are withinthe predetermined distance (No in step 302), the operation detectionsection 111 accepts input of the setting corresponding to the designatedposition upon termination and the display controller 115 clears thesetting screen in the second form (step 303). Then, the processing flowis ended.

On the other hand, when it is determined, in step 302, that thedesignated position upon termination and the displayed item are in astate of being separated by a distance longer than the predetermineddistance (Yes in step 302), the operation detection section 115 movesthe displayed item toward the designated position upon termination andcontinues to display the setting screen in the second form (step 304).Then, the process proceeds to step 302. In this manner, the displaycontroller 115 continues to display the setting screen in the secondform until the designated position upon termination and the displayeditem come within the predetermined distance. When the designatedposition and the displayed item come within the predetermined distance(that is, negative (No) determination is made in step 302), the processproceeds to step 303.

Moreover, in step 302, the display controller 115 may also display ascreen showing setting contents set by designation from an operator, asthe screen 24 shown in FIG. 5C, or a screen for accepting input ofsetting by an operator, as the screen 25 shown in FIG. 5D, instead ofwaiting for until the designated position upon termination and thedisplayed item come into a state within the predetermined distance.

Further, in step 302, when the designated position upon termination andthe displayed item do not come into a state within the predetermineddistance though a predetermined time has passed, the display controller115 may display the screen 24 or the screen 25.

<Other Specific Examples of Setting Screen in First Form and SettingScreen in Second Form>

Next, other specific examples of the setting screen in the first formand the setting screen in the second form will be described. FIGS. 9Aand 9B are diagrams showing another specific example of the settingscreen in the first form. FIGS. 9C and 9D are diagrams showing anotherexample of the setting screen in the second form. Here, a descriptionwill be given by taking a screen displayed after an operator selects theimage 21 a on the screen 21 shown in FIG. 3A as an example,

A screen 26 shown in FIG. 9A performs setting about “Setting A”, and isdisplayed to overlap the screen 21 that has already been displayed. Onthe screen 26, images 26 a to 26 e are provided as images correspondingto five setting items, “Level 1”, “Level 2”, “Level 3”, “Level 4” and“Level 5”, respectively. Moreover, at the time when the screen 26 isdisplayed, a hatched image 26 c is selected; accordingly, the image 26 cis displayed in a mode indicating a selected state. As the modeindicating a selected state, for example, a mode to display a backgroundcolor different from the background colors of images of other settingitems (the image 26 a, the image 26 b, the image 26 d and the image 26e) can be provided.

Here, for example, when an operator moves his/her finger while touchingthe image 26 c, the image to be selected shifts to follow the designatedposition. More specifically, the image to be selected shifts over theimages 26 c, 26 b and 26 a to follow the designated position. Moreover,when the operator removes his/her finger from the screen 26, thedistance determination section 114 determines whether or not the imagedisplayed in the selected state (here, any one of the images 26 a to 26e) and the designated position upon termination are in a state of beingseparated by a distance longer than a predetermined distance.

For example, when the operator removes his/her finger from a state oftouching the image 26 a, if the image 26 a is displayed in the selectedstate, the distance determination section 114 determines that the imagedisplayed in the selected state and the designated position upontermination are within the predetermined distance. On the other hand,for example, when the operator removes his/her finger from the state oftouching the image 26 a, if the image 26 b is displayed in the selectedstate as shown in FIG. 9B, the distance determination section 114determines that the image displayed in the selected state and thedesignated position upon termination are in a state of being separatedby a distance longer than the predetermined distance. In this case,similar to the specific example shown in FIG. 5B, the display controller115 performs control to continue displaying of the screen 26 until theimage displayed in the selected state and the designated position upontermination are brought into the state within the predetermineddistance. Moreover, the display controller 115 may display the screen 24in FIG. 5C or the screen 25 in FIG. 5D.

Moreover, a screen 27 shown in FIG. 9C also performs setting about“Setting A”, similar to the screen 26. The screen 27 is displayed as ascreen different from the screen 21 that has already been displayed. Onthe screen 27, images 27 a to 27 e are provided as images correspondingto five setting items, “Level 1”, “Level 2”, “Level 3”, “Level 4” and“Level 5”, respectively.

Here, for example, when an operator moves his/her finger while touchingthe image 27 c, the image to be selected shifts to follow the designatedposition. More specifically, the image to be selected shifts over theimages 27 c, 27 b and 27 a to follow the designated position. Moreover,when the operator removes his/her finger from the screen 27 and selectsa confirmation button 27 f, the distance determination section 114determines whether or not the image displayed in the selected state(here, any one of the images 27 a to 27 e) and the designated positionupon termination are in a state of being separated by a distance longerthan a predetermined distance.

For example, when the operator removes his/her finger from a state oftouching the image 27 a and thereafter selects the confirmation button27 f, if the image 27 a is displayed in the selected state, the distancedetermination section 114 determines that the image displayed in theselected state and the designated position upon termination are withinthe predetermined distance. On the other hand, for example, when theoperator removes his/her finger from the state of touching the image 27a and thereafter selects the confirmation button 27 f, if the image 27 bis displayed in the selected state as shown in FIG. 9D, the distancedetermination section 114 determines that the image displayed in theselected state and the designated position upon termination are in astate of being separated by a distance longer than the predetermineddistance. In this case, similar to the specific example shown in FIG.7B, the display controller 115 performs control to continue displayingof the screen 27 until the image displayed in the selected state and thedesignated position upon termination are brought into the state withinthe predetermined distance. Moreover, the display controller 115 maydisplay the screen 24 in FIG. 5C or the screen 25 in FIG. 5D.

In this manner, the image processing apparatus 100 related to theexemplary embodiment observes the distance between the positiondesignated by the operator and the displayed item, and, when thedesignation of moving is terminated in a state where the designatedposition and the displayed item are separated by a distance longer thanthe predetermined distance, the image processing apparatus 100 controlsso that displaying of the setting screen in the first form or thesetting screen in the second form is continued until the designatedposition upon termination and the displayed item come within thepredetermined distance. Further, in the setting screen in the secondform, when the operation to confirm the setting contents is performed ina state where the designated position and the displayed item areseparated by a distance longer than the predetermined distance, thecontrol is performed so that displaying of the setting screen in thesecond form is continued until the designated position upon terminationand the displayed item come within the predetermined distance. In thismanner, in the exemplary embodiment, since the screen is continuouslydisplayed until the designated position upon termination and thedisplayed item come within the predetermined distance, occurrence ofmisrecognition about the setting by the operator can be suppressed.

Moreover, the image processing apparatus 100 may also display the screenshowing setting contents set by designation from the operator or thescreen for accepting input of setting by the operator, instead ofwaiting until the designated position upon termination and the displayeditem come into a state within the predetermined distance. To put itanother way, the image processing apparatus 100 performs control tocontinue displaying of the setting screen in the first form or thesetting screen in the second form until a screen showing settingcontents set by designation from an operator or a screen for acceptinginput of setting by an operator is displayed. By the control like this,even though the designation is terminated in a state where the displayeditem has not moved to the position designated by the operator, thesetting contents are displayed or input of setting by the operator isnewly accepted; accordingly, occurrence of misrecognition about settingby the operator can be suppressed.

Moreover, in the exemplary embodiment, when the load of the CPU 101exceeds the predetermined threshold value, the display controller 115may display, instead of the setting screen in the first form, the screenfor accepting input of setting by the operator, as the screen 25 shownin FIG. 5D.

<Description of Applicable Computer>

The processing by the image processing apparatus 100 related to theexemplary embodiment may be implemented in a general-purpose computer.Therefore, assuming that the processing is implemented by a computer200, a hardware configuration thereof will be described. FIG. 10 is adiagram showing a hardware configuration example of the computer 200 towhich the exemplary embodiment can be applied. Note that, in theexemplary embodiment, the computer 200 is used as an example of thedisplay device.

The computer 200 includes: a CPU 201, which is a computing unit; a mainmemory 202, which is a storing unit; and a magnetic disk device (HDD)203. Here, the CPU 201 executes various kinds of programs, such as an OSor applications. Moreover, the main memory 202 is a storage region forstoring various kinds of programs or data used for executing theprograms, and the magnetic disk device 203 stores programs forimplementing respective functional sections shown in FIG. 2. Theprograms are loaded to the main memory 202 and processing based on theprograms is executed by the CPU 201; and thereby each function isimplemented.

Further, the computer 200 includes: a communication interface (I/F) 204for performing communication with outside; a display mechanism 205configured with a video memory, a display or the like; and an inputdevice 206, such as a keyboard or a mouse.

Specifically, the CPU 201 reads the programs for implementing theoperation detection section 111, the CPU load determination section 112,the display screen creation section 113, the distance determinationsection 114, the display controller 115 and the like, for example, fromthe magnetic disk device 203 into the main memory 202 and executesthereof, and accordingly, these functional sections are implemented.

Moreover, it is possible to provide programs that cause a computer toimplement the exemplary embodiment according to the present invention bya communication tool, of course, and it is also possible to storethereof in a storage medium, such as a CD-ROM, to be provided.

The foregoing description of the present exemplary embodiment of thepresent invention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Thepresent exemplary embodiment was chosen and described in order to bestexplain the principles of the invention and its practical applications,thereby enabling others skilled in the art to understand the inventionfor various embodiments and with the various modifications as are suitedto the particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

What is claimed is:
 1. A display device comprising: a display unit thatdisplays a screen including a displayed item; and a display controllerthat, in moving the displayed item toward a designated position on thescreen, when designation of the moving is terminated in a state wherethe displayed item and the designated position are separated by adistance longer than a predetermined distance, performs control tocontinuously display the screen until the displayed item and thedesignated position at a time of terminating the designation come withinthe predetermined distance, or a setting screen about setting based onan operation by an operator is displayed.
 2. The display deviceaccording to claim 1, wherein a state where the displayed item and thedesignated position at the time of terminating the designation arewithin the predetermined distance refers to a state where the displayeditem has moved to the designated position at the time of terminating thedesignation.
 3. The display device according to claim 1, wherein, in thesetting screen, the display controller displays to show setting contentscorresponding to the designated position at the time of terminating thedesignation or setting contents corresponding to a position of thedisplayed item at a time of displaying the setting screen.
 4. Thedisplay device according to claim 1, wherein the display controllerdisplays, as the setting screen, a screen that accepts input of thesetting by the operator.
 5. The display device according to claim 1,wherein, when the displayed item and the designated position at the timeof terminating the designation are in the state of being separated by adistance longer than the predetermined distance in a case where asetting operation by the operator is accepted on the screen afterterminating the designation, the display controller displays the settingscreen.
 6. The display device according to claim 5, wherein, in thescreen, a setting item corresponding to a designated position isdetermined in advance, and the setting operation confirms the settingitem corresponding to the designated position at the time of terminatingthe designation.
 7. The display device according to claim 5, wherein, inthe screen, a setting item corresponding to a designated position isdetermined in advance, and, when an operation to cancel the setting itemcorresponding to the designated position at the time of terminating thedesignation is not performed within a predetermined time, the displaycontroller performs processing assuming that the setting operation hasbeen accepted.
 8. The display device according to claim 1, wherein, whenthe designation is terminated in the state where the displayed item andthe designated position are within the predetermined distance, thedisplay controller performs control to clear the screen at the time ofterminating the designation.
 9. The display device according to claim 8,wherein, when the designation is terminated in the state where thedisplayed item has moved to the designated position, the displaycontroller performs control to clear the screen at the time ofterminating the designation.
 10. An image processing apparatuscomprising: an image processor that performs image processing; a displayunit that displays a screen including a displayed item used for settingin the image processing; and a display controller that, in moving thedisplayed item toward a designated position on the screen, whendesignation of the moving is terminated in a state where the displayeditem and the designated position are separated by a distance longer thana predetermined distance, performs control to continuously display thescreen until the displayed item and the designated position at a time ofterminating the designation come within the predetermined distance, or asetting screen about setting based on an operation by an operator isdisplayed.
 11. A display method comprising: outputting data fordisplaying a screen including a displayed item; and, in moving thedisplayed item toward a designated position on the screen, whendesignation of the moving is terminated in a state where the displayeditem and the designated position are separated by a distance longer thana predetermined distance, performing control to continuously display thescreen until the displayed item and the designated position at a time ofterminating the designation come within the predetermined distance, or asetting screen about setting based on an operation by an operator isdisplayed.
 12. A non-transitory computer readable medium storing aprogram that causes a computer to execute functions, the functionscomprising: outputting data for displaying a screen including adisplayed item; and, in moving the displayed item toward a designatedposition on the screen, when designation of the moving is terminated ina state where the displayed item and the designated position areseparated by a distance longer than a predetermined distance, performingcontrol to continuously display the screen until the displayed item andthe designated position at a time of terminating the designation comewithin the predetermined distance, or a setting screen about settingbased on an operation by an operator is displayed.